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Organic synchronization is a method for the mutual synchronization of a 
set of geographically separated clocks. It is applicable to pulse code modula- 
tion (PCM) communications networks and to other systems which have- 
similar requirements for synchronism. 

After a brief review and history of the problem, a model for organic 
sijnchronization is developed. A control-independent study of possible 
equilibrium solutions is then carried out. A special class of controls is shown 
to provide asijmptotic stability in the limiting case of zero delays. This 
result leads heuristically to the synthesis of a broad class of nonlinear con- 
trols. With these controls, the systems are represented by families of non- 
linear differential-functional equations. This model provides a basis for 
the simulation of organic synchronization. Broad conditions which are 
mathematically sufficient for the stability of the nonlinear systems are not 
yet known. The final frequencies of a linear subclass of organic systems, 
known to be stable, are examined. 

I. INTRODUCTION 

The timing of the switching actions at each switching center of a pulse 
code modulated (PCM) communications system is governed by a device 
called the "local clock." It may consist of a cyclic counter driven by an 
oscillator. Each cycle of the counter is then one clock cycle. 

In a geographically widespread PCM system, the local clocks may be 
either autonomous or synchronized. This choice should be made with 
the best possible knowledge of the available technology, as well as con- 
sideration of its functional and economic consequences. The choice is 
clearly a rather basic one, and it may have long term effects upon the 
evolution of the system. 

The time-multiplexed PCM signals arriving at any locality may have 
arbitrary, and usually scattered, points of origin. Some of them require 
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decoding into a common analog form. In particular, they may be voice 
signals. A homogeneous, time-multiplexed set of such signals is easily 
decoded by a common digital-to-analog converter, provided that the 
transmitted samples have been generated synchronously. A nonsyn- 
chronous alternative is to insert extra digits into the signals in order to 
permit multiplex transmission. Additional equipment is needed to re- 
move these digits and smooth the timing of the demultiplexed samples 
before or after decoding them. 

This paper is only one of a number of studies of system synchroniza- 
tion, and it does not provide a complete solution to the problems touched 
upon. After a very brief review of some past work in this field, I shall go 
back to fundamentals to derive a model for organic synchronization. 
Following this, the sections entitled "Equilibrium Points", "Reduced 
System Equations", "Controls: Qualitative Discussion", and "System 
with Zero Delays" provide background for the synthesis of a family of 
controls which is introduced under the heading, "A Family of Realizable 
Organic Systems". 

The question of the final frequencies of certain linear organic systems 
is then taken up. Finally, some remarks are made to clarify the stability 
problem. 

II. HISTORY 

The synchronization of PCM networks has long been a subject of 
interest. The question of synchronizing switching centers, in addition to 
the transmission links, arose in 1956, when the PCM telephone switch- 
ing experiment, later named Essex, 1 was planned. 

The term "organic synchronization", which seems to have been in- 
troduced by V. E. Bene§, 2 will be used herein for systems fitting the 
model to be derived in later sections. The systems treated by Benes, 
excepting a certain minor idealization, form a subclass of these systems. 
This same subclass of systems is discussed in a patent 3 by J. P. Runyon. 

Bene§ 2 has demonstrated asymptotic stability for his systems, which 
are linear, under quite interesting conditions. He has also given formulas 
for the asymptotic system frequency and for the asymptotic relative 
phases of the oscillators. A. J. Goldstein 4 has given simplified derivations 
of these formulas. 

An alternative mutual synchronization method, called "frequency 
averaging", has been treated by Benes and Goldstein. 5 Frequency 
averaging systems, while stable, lack a frequency determining element. 
Each oscillator puts out the average of the frequencies received from its 
neighbors, and the system frequency will wander in the presence of 
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noise. Because of this feature, it does not seem to be very practical, 
unless it is combined with other techniques. 

The transmission of a synchronizing signal from a master oscillator 
to all other oscillators, which are locked to this signal, is perhaps the 
simplest approach to synchronization. However, such a system is vul- 
nerable to failure of the master oscillator or failure of a transmission 
link. Means for mitigating this weakness have been proposed by G. P. 
Darwin and R. C. Prim. 6 They equip the system with automatic means 
to reorganize itself in the event of a failure. Unfortunately, this adds 
considerable complexity to the basically simple method. 

Further discussion will be limited to organic systems for synchroniza- 
tion. 

B. J. Karafin 7 has carried out some digital computer simulations of 
organic synchronization of small systems. A. Gersho and B. J. Karafin 8 
have simplified the proof of asymptotic stability for Benes' systems. 
C. J. Candy and M. Karnaugh 9 have studied organic systems of up to 
four switching centers by means of an analog simulator. M. B. Brilliant 
has also studied linear organic systems 10 and has computed transient 
responses of certain large linear systems. 11 

Linear systems with zero delays have also been studied at the Univer- 
sity of Tokyo by T. Saito, H. Fujisaki and H. Inose. 12 

III. THE SYNCHRONIZED NETWORK 

Consider a set of N ^ 2 geographically separated pulse code switch- 
ing centers, interconnected by directed pulse transmission links, as 
illustrated in Fig. 1 for the case AT = 4. 

All possible links need not be physically provided. The cases of great- 
est interest are those in which there is a directed path from any center 
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Fig. 1 — A sample network. 
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to any other center, possibly by way of some intermediate centers. 
Systems with this property will be called "connected systems". 

A connected system of N centers must have at least N links, because 
at least one link must terminate at each center. When the centers are 
connected in a unidirectional loop, there are exactly N links. The maxi- 
mum possible number of links, assuming no duplications, is realized 
when every ordered pair (i,j) of distinct centers is connected by a link 
to i from,/. This number is N(N — 1). The correspondence between the 
ordered pair (i,j) and the direction to i from j is a convention which will 
be followed consistently. 

An important component at each center is the local clock which de- 
termines the timing of all switching actions at that center. The messages 
from all other centers arrive in the form of framed pulse codes. These are 
pulse codes divided into sequences containing equal numbers of digits 
by means of periodically introduced framing digits. In order for the pulse 
codes to be correctly processed, a correct phase relationship must exist 
between the arriving framed code and the local clock. 

The desired phase relations are realized by providing a certain amount 
of buffer storage for each incoming link. 13 Such equipment is illustrated 
in Fig. 2. The arriving digits are stored in a cyclically addressed discrete 
memory. They are read out of the memory under control of the local 
clock and of a circuit which monitors the appearances of the framing 
digits, so as to be correctly phased. 















SIGNAL 


INPUT 
REGISTERS 


















1 1 






TIMING 
EXTRACTOR 
















1 












2 
















WRITE 
SELECTOR 


3 


WRITE 
SELECTOR 


















4 




















l 
1 
1 
1 

MEMORY 

1 
1 
1 

1 










COUNTER 






FRAMING 

CONTROL 
SYSTEM 






i 


l 
l 
1 


1 FROM 
1 LOCAL 
1 CLOCK 


























K 


















i 1 










OUTPUT 




SIGNAL 






REGISTERS 

















Fig. 2 — Buffer memory. 
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Other forms of buffer memory which incorporate variable delay lines 
have also been proposed. These may be acceptable and less costly in 
some cases. 

Under favorable conditions, the arriving signals can be correctly 
phased by means of the buffers. However, unless the oscillator frequencies 
are properly controlled, their phase differences will wander beyond any 
bound. Then, some of the buffer stores will fill up or be emptied, causing 
erroneous codes to appear at their outputs. It is the primary object of 
the controls to avoid such malfunctions. The system will be considered 
to be operating synchronously when no information is being lost in this 
fashion. 

I shall adopt the point of view that it is desired to keep the buffer 
memories just half full, in which case the system would not be unduly 
vulnerable to transient disturbances. Controls will be sought which tend 
to inhibit large deviations from the desired condition. We shall see that 
these deviations cannot, in general, be reduced to zero. The oscillator 
control signals will be derived from them. 

It should be noted that the transmission delays between centers are 
variable over some small fractions of their center values. These delays 
will depend upon the environmental conditions of the propagating media 
and on message-induced jitter at pulse repeaters. 14 The buffer memories 
must mop up the delay variations as well as the effects of phase wander 
of the oscillators. 

IV. NOTATION 

The single subscripts i, j, k, • • • , refer to the various centers and to 
the oscillators located at these centers. Their range is the integers, 1, 2, 
• • • , N. When one of them appears in a statement or equation with no 
other qualification, the statement or equation holds over the whole 
range. 

It has already been pointed out that the ordered pair (j,i) designates 
the link to center j from center i. When a statement or equation con- 
tains a pair of subscripts with no other qualification, it holds for all 
pairs (j,i) which designate existing links. 

The set of all existing links will be called R. Thus, (j,i) e R means 
there is a link to j from i in the system. 

Similarly, Ri is the set of links terminating (i.e., receiving) at center 
i, and Si is the set of links originating (i.e., sending) at center i. Thus, 

R= URi= US, = U JO",*)}. 
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Let M be the number of links in the system. We have seen that 
N g M g N(N - 1). 

System controls will be supposed in effect for t ^ 0. Prior history of 
the system provides the initial condition. Statements about functions of 
t with no other qualification will hold for t ^ 0. 

Occasionally, vectors will be used having N singly subscripted com- 
ponents or else M doubly subscripted components. For example, the 
delay vector % has the M components ry, , (j,i) e R. It will be clear 
which vector space is meant in each case. 

V. PHASE, FREQUENCY, AND DELAY 

The local clocks will emit coherent signals. That is, for time intervals 
which are very long compared to one period of the clock, the output will 
be approximately periodic. Under these conditions, many formally 
different definitions of instantaneous frequency will be in good numerical 
agreement. I shall simply postulate the existence of such continuous 
functions, /,(£) . 

Phases of the oscillators are defined to be 

Pi (t) = p,-(0) + f fMds (1) 

J o 

in cycles, and 

/,• = Pi'. (2) 

The principal value of the phase is 

<Pi = pi modulo 1 (3) 

and has the range ^ <pi < 1. 
The initial condition for the phases will be 

p<(0) = w(p). (4) 

The values, <Pi(0), are observables of the physical system. In fact, the 
switching actions at center i are timed according to <pi(t). 

If there is a transmission link to center j from center i, the signals 
transmitted therein will be subject to a time delay Ta(t). If a pulse is 
launched from center i at a time h and received at center j at time £ 2 , 
then the delay is defined to be 

Tji{h) = h- k. (5) 

Analogously, the phase of the signal received at time t by center j 
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from center i is defined to be 

Pn(t) = p& - r H {t)\. (6) 

It should be recognized that the principal phase of a timing wave 
recovered from the received pulse code would, in practice, only approxi- 
mate <pji(t). Errors of a few percent of one pulse period are common in 
pulse repeaters. 14 This corresponds to a fraction of one percent of a typi- 
cal frame period. 

The frequency of the received signal is obtained by differentiation of 

(6). 

fa{t) = [1 - r//(01 -W- rji{t)]. (7) 

This equation displays the Doppler shift of frequency caused by varia- 
tion Of Tji . 

The clock frequency at the it\\ center may be represented in the 
idealized form 

/,(*) = F + Bi + g t (t) + Vi(D. (8) 

F is the mean center frequency of all clocks in the system, averaged 
over the time during which the system is observed. E t is the incremental 
center frequency of the itb. clock, also time averaged. By definition, 

£ Et = 0. (9) 

The time function g { (t) is the contribution of the system controls, 
while rn(t) is a random noise with zero mean. There will be a symmetrical 
bound on gi(t), 

\gdt)\^G, (10) 

which is supposed to be larger than the other frequency deviations. This 
is necessary if the controls are to bring all oscillators to the same average 
frequency. Under realistic conditions of operation, 

G > max \Ei\ + max a IfJ rn(s)ds) (n) 

where o-(-) is the standard deviation. 

VI. FUNCTION OF THE BUFFER MEMORY 

The principal phase of the signal arriving at center j from center i 
will usually not agree with that of the oscillator at j. The purpose of 
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the buffer memory in this link is to delay the signal by an additional 
time, dji(t), so that 

<Pj(t) = <PjiU - d H {t)]. (12) 

In view of (6), this can be written 

vj(t) = Pitta), (13) 

where 

tn = t - dj { (t) - rjJLt - d H (t)}. (14) 

Taking the right-hand derivative of (13), and because this derivative 
of the principal phase is always equal to the derivative of the phase, we 
get 

fj(t) = [1 - d,/(0]-{l - r„'[t - d 3i (t)]} •/,(*„), (15) 

where physical considerations make it clear that 

I dj/\ , | r y /| « 1. 

Equation (15) implies the dependence of da on ft ,f h and T }i . 

Matters can be simplified by shifting attention from the delays in the 
buffer memories to the numbers of frames, i.e., clock cycles, they con- 
tain. The number of cycles in the (j,i) buffer at time t is: 

Vji(t) = P»(t) - Pii[t - d,i(t)] (16) 

and 

yji'it) = /*(*) - [i - <*j/(0]-//*B - d H {t)}. 

Using (7) and (15), this can be put in the form 

yj/(t) =Mt) -hit), (17) 

which equates the rate of accumulation of cycles to the rate of arrival 
minus the rate of removal. In terms of the oscillator frequencies, 

yj/it) = [1 - rj/iOhUt - r„(0] - fj(0. (18) 

Suppose the (v) buffer has a capacity of 2D a cycles. The normalized 
state of this buffer is defined to be 

zn(f) = D^-biS) - Dnl (19) 

which is the fractional deviation of its contents from half its capacity. 
In terms of this variable, (18) becomes 

xj/(t) = Z^rMl - ry/(0]-/<P - r*(0] - D H -*-Mt). (20) 
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This equation explicitly relates the derivative of the buffer memory 
state variable, x(/), to the delays and clock frequencies in the system. 

I have remarked that the frequencies should be controlled so as to 
prevent any buffer memory from emptying or filling. For example, if 
buffer (j,i) is nearly empty, then we desire /, > /,- until the situation is 
sufficiently corrected. On the other hand, if the (j,i) buffer is nearly 
full, then the inequality is reversed. However, things are complicated by 
the fact that all buffers associated with the ith center, that is, those in 
links of the set Ri \J Si , are affected by a change in /,• . 

The system is said to malfunction whenever 

max | Xji(t) | > 1, 

that is, whenever the buffer memory state vector leaves the "unit cube". 
Defining the nonnegative scalar, 

r»(x) = max \xa\, (21) 

(j.i)tn 

we see that the system is in a permitted buffer state when 

r„(x) ^ 1. (22) 

VII. EQUILIBRIUM POINTS 

Suppose the system is so controlled that an equilibrium solution to 
the system equations is possible. That is, in the absence of disturbances, 

x(t) = for t ^ 

and there exists a constant / such that 

fi(t) = f for t ^ 0, i = 1, 2, •••,#. 

If the system, in or near this state, is disturbed by a change in the net- 
work configuration, noise in the oscillators, or changes in some of the 
delays, then variations in the state of the buffer memories will result. 
To minimize the chance of malfunction under such disturbances, it seems 
reasonable to seek an equilibrium in which the buffer state is, in some 
sense, near x = 0. That is, the buffers are nearly half full. 

I shall begin along these lines by seeking the set of equilibrium points 
which can be reached from arbitrary initial conditions and under any 
controls whatever. The situation of asymptotic equilibrium to be con- 
sidered is as follows. 

(/) rj(t) = for t ^ 0. 

(ii) Tji (t) = Tji(0) > for t ^ 0, (j,i) eR. 
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(Hi) lim fi(t) = f for i = 1, 2, • • •, N. 

(iv) lim \pi(t) - p(t)] = q { for i = 1, 2, • ••, N, 

where 

p(0 =^tpi(t), |g.-|< oo. 

Let x = lim x(£)- The locus of attainable points x will be examined 

t-*00 

under the above conditions. 

With the delay vector t assumed to be constant, (20) has the sim- 
ple form, 

**' = Djr'-fid - rji) - d^-m). 

Therefore, 

xji = %(0) + ( Xji'(t)dt 
Jo 

= Xji (o) + Djr 1 1 [fid - rji) - fjitm. 

Jo 

The integral may be evaluated, using (1) and the conditions (Hi) and 
(iv) of asymptotic stability. The result is, 

xji = Djr'iqi - & ~ raf) + Bh , (23) 

where 

B H = z }i (0) + Djr'ipjiO) - Pii-rji)] (24) 

is a constant which depends upon the initial condition. Equations (23) 
express the set of buffer memory equilibrium states attainable from a 
given initial condition in terms of the asymptotic phase differences and 
the asymptotic system frequency. This set depends upon the initial 
condition through the parameters, Z?,< 

It is shown in Appendix A that the set of phase differences 

{ (ft - h) I U,i) * R) 

contains exactly (N — 1) linearly independent elements. There are M 
components of the asymptotic buffer state vector x, with M ^ N. 
Therefore, if / were an unconstrained real variable, we see that, as a 
function of the phase differences and /, x would range over an N-d\- 
mensional linear manifold of its M-dimensional space. 
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However, the system frequency / must be near F, the average center 
frequency of the clocks. More specifically, 

F + max Et - G < f < F + min E { + G. 

i i 

This inequality requires that the bound on the magnitude of the fre- 
quency control be large enough to reduce the highest frequency below 
the system frequency and to raise the lowest frequency above the system 
frequency. Thus, all clocks can be brought to a common frequency, even 
in the presence of noise. Nevertheless, G « F in cases of practical in- 
terest. 

In a typical application, G = 10 -6 F, so the domain of allowed values 
of / is a very narrow interval. It may be said that the range of x is a 
neighborhood of an (N — 1) -dimensional linear manifold. The distance 
of this manifold from the origin is determined by the initial condition. 

In cases of practical interest TjiG « 1, so that 

P/(0) - Pi(-Tii) =* Tjj+PiiO) ~ p,(0). 

In such cases, (23) has the approximation 

Xji S x„(0) + Dji-% - qj + p,(0) - p,(0)]. (25) 

From this it is clear that .<-,, = .»•>,- (0) if q t — Qj equals p,-(0) — />>(0). 
Therefore, an asymptotic state vector x which is, in some sense, small is 
attainable when the initial state vector x(0) is small in the same sense. 

VIII. REDUCED SYSTEM EQUATIONS 

The trajectory of the buffer memory state vector is of central im- 
portance to this work. However, the system controls operate directly 
upon the clock frequencies. For this reason, it will be convenient to shift 
attention from the M equations (20) to an iV-dimensional vector equa- 
tion for the frequencies. This equation, and its component equations, 
will be called the "reduced" system equations because N % M. 

I shall proceed under the assumptions of no frequency noise and con- 
stant delays; 

1(0-0 (26) 

i(0 - *(0). (27) 
Then, (20) can be integrated to the form 

*„(0 = Dj- l [ Pi (t - ra) - p y (0] + B H , (28) 
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where, as before, B>, depends upon the initial condition and is denned 
by (24). 

Now a simple change of variables is made. 

ft(0 =Vi(t) -ft. (29) 

In vector notation, this is, 

q(0 = P(0 -ftU, (30) 

where \ N is an iV-dimensional column vector with unit coordinates. 

If the system is asymptotically stable at the frequency /, then q (t) 
will go asymptotically to zero. Therefore, given any controls, it will be of 
interest to see whether this condition is realized for any value of / in 
the allowed domain. 

Substitution of (29) in (28) gives 

xjdt) = Dj-^qdt - T Si ) - qj(t) - Tji j] + Bj t . (31) 

In view of (2), (8), (26), and (30), 

q'(0 - (F-/)l* + E + g(*), (32) 

where g(Z) is the increment to the clock frequencies under system con- 
trol. In particular, let 

g(0 =rf/,x(-)}. (33) 

Each component of r must have a realizable dependence upon the buffer 
memory state vector trajectory. The problem of control synthesis is 
precisely the problem of finding a suitable form for r. 

The reduced system equations are the differential-functional equa- 
tions, 

q'(0 = (F - f)ls + E + r{<,x[q(.),/, B]|, (34) 

with x defined by (31). The parameter, B, which depends upon the 
initialization of the system, enters (34) as a parameter in the controls. 
It is, therefore, not surprising that the system's trajectory and its final 
state, if any, depend upon its initialization. B is not entirely arbitrary. 
This can be seen by applying the condition for phase agreement, (12) 
at t = 0. Some manipulation of (16), (6), (12), (19), and (24) shows that 

B H = Dj^Ka- 1, (35) 

where K^ is an integer, and 

Kji - yji(0) + P/(0) - pd-tji). 
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Given the initial phases, the initial condition can be changed only by 
integral changes in the numbers of cycles y(0) stored in the buffer mem- 
ories. 

ix. controls: qualitative discussion 

Loosely speaking, it is desired to control the system so as to keep the 
buffer memory state vector small, in some appropriate sense. More 
specifically, the vector should be kept away from the faces of the unit 
cube. 

These qualitative considerations will be made more concrete by de- 
fining a class of real valued functions r(x) of the buffer memory state 
vector, which will be called "penalty functions". Each such function 
will have the following properties: 

(i) r(0) = 0. 
(n) r(— x) = r(x). 

(Hi) r(x) has a continuous gradient Vr(x). 

(iv) r(x) is strictly convex; that is, for any two distinct vectors 
Xi , x 2 and any real number X in the open interval (0, 1 ) , 

r[\X! + (1 - X)x 2 ] < Xr(xi) + (1 - X)r(x 2 ). 
(v) For any x such that 

I x I = 1, \m\—. — r = 0. 
s-»» r(sx) 

These functions will have a unique minimum at the origin and will go 
to infinity uniformly on all rays from the origin. When properly chosen, 
their convex surfaces of constant value may closely approximate the 
cube surfaces having equal values of max | xa\. This latter quantity, 

R 

however, does not have a continuous gradient. 

The attainable equilibrium points have been shown to lie in a neigh- 
borhood of an (N — 1 ) -dimensional linear manifold. The infimum of the 
values of r(x) over this set is realized at a unique point in its closure. 
This point is either the origin or else the point of tangency with a surface 
of constant r. After selecting a suitable penalty function, controls will 
be sought which bring the buffer state vector near this point. 

In attempting to reach this objective, a subclass of penalty functions 
having the simple form 

r(x) = £ u(xn) ( 36 ) 
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will be employed. The function u (• ) must have the properties, (i) 
through (y), of a penalty function on a one-dimensional real space. A 
simple example of such a function is 

u n (x) = x 2n , n = 1, 2, 

Fig. 3 illustrates the surfaces, 

r M = max (.ri2 , x 2 i) = 1 

2 , 2 n 

r 2 = .ri2 4 + .r 2 i 4 = 1 

6 , 6 , 

? - 3 = Xl2 + .1-21 = 1. 

The last three are penalty functions of the type defined in (36), for a 
system having just two finks. 

X. SYSTEM WITH ZERO DELAYS 

The family of systems under consideration will have widely varying 
nonnegative delays for the transmission links. In many cases of interest, 
the product of maximum loop delay and control bandwidth may be very 
small compared to unity. In such cases, the extrapolation to zero delays 




Fig. 3 — Curves of unit value. 
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may be a useful and illuminating exercise. One such system will be 
treated here as a step toward the synthesis of a family of controls. 

In the zero delay case, let the controls r be simply a function of x. 
This results in a system of ordinary, autonomous differential equations. 

q'(0 = (F -f)i„ + E + r(x) (37) 

in which x is now denned by 

xn{t) = Djriqiit) - qi (t)] + B j{ . (38) 

The synthesis of r(x) will be based upon a penalty function which 
takes the form given in (3G). One of the desired properties of the system 
(37) is that it come to rest near the attainable minimum of r(x). It is 
therefore reasonable to try controls which have a component along the 
negative gradient of r(x). 

Let V g r(x) be the column vector whose ith component is 

[V fl r(x)], = ^-r(x) (39) 

and let A be any N X N positive definite matrix. The controls to be 
considered here are of the form 

r(x) = -AV,r(x). (40) 

Thus, we are assured that* 

[-V a r(x)f-r(x) ^ (41) 

with equality if and only if V 8 r(x) = 0. 
Make the linear change of variables, 

w(0 = A~\(t). (42) 

Then, the system equations are 

w'(/) = A-\(F - f)U + E] - V(x). (43) 

The inverse of a positive definite matrix is also positive definite. 
Therefore, 

\/A-% > 

and it is possible to choose / such that 

U T A-\(F - f)U + E] = 0. (44) 



The superscript T will indicate the transpose of a vector or matrix. 
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It is easy to verify that 

l/V g r(x) =0 (45) 

in the zero delay system. Having chosen / to satisfy (44), we find that 
the trajectory of w must lie in a linear manifold which is orthogonal to 
ljv . It will now be shown that the system exhibits global asymptotic 
stability when w is restricted to this linear manifold. That is, from any 
starting point in the manifold, the system will ultimately come to rest 
at a unique point in the manifold. 
Consider the following function : 

L(w) = -vr T A T A- l {(F - J)\ N + E] + r(x). (46) 

Because of some of the properties of r(x) and the connectedness of the 
systems under study, it can be shown that Z/(w) has a unique minimum 
in every linear manifold orthogonal to 1# . Also, V (t L(w) is zero only at 
this minimum. The proofs are given in Appendix B. 
The time rate of change of L(w) is 

L(w) = [W(t)] T V w L(w). 

But 

V w L(w) = -A T A-\(F - f)U + E] + A T V g r(x) 

= -A T w(t). 

Therefore, 

L(w) = -[w'(t)] T A T w'(t) = -[w'(t)] T AW(t). (48) 

In view of the hypothesis that A is positive definite, 

L(w) ^ 0, 

with equality if and only if w '(/) = 0. When this occurs, 

-lV(«) = V,„L(w) = 

and the system is at the minimum of L(w). Thus, L(w) is a Liapunov 
function for the system 15,16 and the system is globally asymptotically 
stable in the restricted sense mentioned above. 
Inasmuch as 

q'(0 = Aw'(t), 

w' (t) = implies q'(0 = and the system of (37) and (40) is also 
globally asymptotically stable in the linear manifold of its motion. 
It is apparent from the definition (30) of q(/) that the system has 
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the common frequency / when q (t) = 0. The Liapunov function 

L(w) = t(q) = -q T A~ l [(f - /)lv + E] + r[x(q)] 
lias its minimum at the equilibrium point, q mill , where 

V g L(q mill ) = -A- l [(F - /)1 + E] + v>[x(q mill )] = 0. 

The equilibrium point is seen to be offset from that point at which 
V,r = when the mistuning E of the clocks does not vanish. This should 
not be surprising, because the controls must compensate for the fre- 
quency differences. 

Suppose the (N — 1) -dimensional subspace orthogonal to 1^ is in- 
variant under A -1 . Then the requirement (44) reduces to / = F, and 
the system frequency is the average of the clock center frequencies. It 
can be shown that when the matrix A has the above property, its column 
sums are all equal. In particular, if a diagonal matrix has this property, 
it is the identity matrix, multiplied by a positive scalar. 

In this section, I have considered global asymptotic stability, rather 
than trajectories within the unit cube. Attainment of a suitably bounded 
trajectory will depend upon the A matrix and the initialization of the 
system. 

XI. A FAMILY OF REALIZABLE ORGANIC SYSTEMS 

In the last section, the controls 

r(.r) = - Av q r(x) = -4V, JLu(xji) 

R 

were shown to stabilize the system of (37) with zero delays. A family of 
controls will now be synthesized so as to be realizable and practical for 
systems having positive delay. 
Equations (38) show that 

^-u(Xji) = Djr'id* - b^u'ixa) (49) 

do- 
using the Kronecker 5 notation. Thus, when the matrix A is diagonal, 
the controls for the clock at center i depend only upon the buffer memory 
states in links terminating at center i or originating at center i. This is a 
very desirable simplification, and there seems to be no merit in employ- 
ing more complicated forms. A more general type of control having this 
property is 

r*(x) = J^ a kj u'(x kj ) — XI b jk u(x jk ), (50) 

"k s k v ' 
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where the signs have been chosen to agree with the earlier model when 
aid , bjk are positive. The development is quite heuristic at this point, 
because a proof of stability for the system having the controls (50) with 
arbitrary positive coefficients is lacking. 
The final model is based upon a modified form of the controls (50). 
(?) To achieve readability, a delay A kj must be imposed on the 
argument of a control signal from the (j,k)th buffer memory to 
center k. 
(ii) The controlled frequency deviations must be limited. For this 
purpose, I introduce the limiter function p(- ) such that 

P (x) = x, \x | ^ 1 

= 1, x > 1 

= -1, x < -1. 

(Hi) For the purpose of reducing system bandwidth, a filter with 
impulse h(t) and unit dc response may be employed. Let * 
indicate convolution. 

I\{*,x(-)} = Gp (h(t)* jZa^WO] 

K Ui , (51) 

- J2 bjiu[xji(t — At/)U\ 

The complete system equations are 

q'(0 = (F - f)l„ + E + rM-)} + n(«) (52) 

xji(t) = Dj-'lqlt - Tji (t)] ~ qj(t) ~ r H {t)f\ + B Si (53) 

Bji = xji(0) + Dj-^pjiO) - pd-rjiiO)}. (54) 

Equations (53) and (54) have been obtained by integration of (20). 
The definition of the delay A,, in (51 ) will depend upon the manner 
of transmission of the control signal. When the state Xa is transmitted 
to center i via link (i,j), 

An = A*y(<) = da(t) + TiM - dud)]. (55) 

This form is particularly awkward because the buffer memory delay, 
dij(t), is not one of the canonical variables. However, it can be very 
closely approximated as follows : 

disW^Diilxuit) + 1]F. (56) 

A simpler but cruder approximation is 

d^iD^DiiF. (57) 
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In the special case of (51), for which 6 Jt - = 0, this complication does 
not arise. 

XII. COMPARISON WITH THE SYSTEMS OF BENES 

V. E. Benes 2 has analyzed a class of linear systems having delays and 
filters. In my notation, these systems obey the equations 

p/(0 = F + Ei + Gh(t)* E oalpid - Tii ) 

(58) 

-Pi(t)]+m(t). 

He considers the delays to be fixed, the systems to be connected systems, 
and adds the constraints 

da > for (i,j) e R f 
Z 2.i = I- 

Then, assuming the noise if (2) to be bounded and to go asymptotically 
to zero, he finds a sufficient condition for global asymptotic stability. 
This asymptotic stability is defined by 





lim pi'(t) = 

t-.oo 


f, 


i=l,2,---,N 




llim ]pi(t) - p N (t)]\ < oo, 

| t-*°o 1 


i= 1,2, -.., (N- 


-1). 


Benes sufficient condition is that 






G > 








GH(iw) 
in + QH(iu) 


< 1 


for all co 9^ 0. 





H (s) is the Laplace transform of the filters' impulse response, h(t); 
co is real radian frequency, i is the imaginary unit, and it is assumed that 
tf(0) = 1, as before. 

This condition is stricter than that needed to stabilize an ordinary 
phase controlled oscillator, but it is not too difficult to satisfy. It is also 
quite remarkable in its independence of the system graph and its delays. 

Benes also gives formulas for the final system frequency and phase 
differences. These have been rederived more simply by Goldstein, 4 using 
the final value theorem. 

A very direct approach to the final values is to insert them in (58), 
replacing the convolution with Ghit) by multiplication with G. 
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Let 

Km p/(f) = f 

t-*CO 

lim \pi(t) - p»(t)] = pi 

t-»oo 

and note that 

lim \pi(t - th) - pt(t)] = —Ttjf. 

i-.co 

Making the appropriate changes in (58 ) , 

f=F + Ei + GT, OiiiPi ~ Pi ~ Tij}. 
Hi 

Because p N = by definition, we now have a set of N linear equations 
in the N variables f, pi , • • • , Pn-i ■ Using the notation, 

Ti = X/ O-ijTij , 

for an average of the delays in the links to the ith. center, the equations 
assume the simpler form, 

(1 + Gu)f + Gfi - G E aijpj = F + E t . (59) 

They have been shown by Goldstein to give the following solution for / 

/-Z±£Wt. (60) 

J 1 + GZbin 

Here 6, , i = 1,2, • • • , N, depends only upon the averaging coefficients, 
an , (i,j) e R, and 

bi ^ 

Zbi = 1. 

A glance at (60) shows that the final system frequency is monotone 
decreasing with the product of the dc gain, G, and an average of all 
delays in the system. This effect has caused some dismay, but it results 
from an unrealistic model. 

Let us go back to the family of organic systems defined by (51) 
through (54) and (29). These will be specialized in such a way as to 
obtain a class of linear systems analogous to that of Benes. The follow- 
ing steps must be taken. 

(i) Eliminate the limiter, p(- ), from the controls, (51). 
(u) Let u (£,•,-) = £.?,/, so u'(xij) = Xn. 
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(iii) Use the phase variables, 

Pi(t) = Qi(t) +fl. 

(iv) Set bji = 0, for all (j,i), in (51). 
(v) Make the identification 

a,j = a^Dif 1 
and impose the constraint, 

E Sfi = I- 

(vi) Assume the delays to be constant. 
With these changes, 

p/(t) = F + #•• + G%(*)* Z S.vW* - r«) - pt(t)] 

(61) 
+ (?E ^^(0) + p,-(0) - pX- t,/)] + *(*). 



This set of system equations differs from those of Bene§, (58), only in 
the addition of a term which is constant in time, but which depends 
upon the initial condition. It may be considered to be a modification of 
the mistiming, E t , in the treatment of the stability problem. Therefore, 
the proof given by BeneS of global asymptotic stability under his suffi- 
cient condition also applies to (61). 

Now let us derive the equations for final values. In doing this, note 
that the jth oscillator has the natural frequency, F + Ej, for t < 0, 
while its frequency has the final value /. Therefore, 

Pi(-Tij) = Pj(0) - TijiF + Ej) 

lim \pj(t - Tij) - pj(t)] = - Tijf. 

Now, proceeding as before, (61 ) leads to 
/-F + ^ + flZ a ir (pi - Pi - Tijf) 

Hi 

+ (?E *«U>«j*tf(0) + p«(0) - p>(0) + r ir (F + E,)\ 

R i 

Putting this in a form analogous to (59), 

(1 + Griff + GPi - G £ &aPi = (1 + Ort)F + A 

_ *' (62) 

+ (?Z atjWijEj + DijXaiO) + p,(0) - p y (0)]. 
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The solution for/, analogous to (60), is 

G E MM>tf*i(0) 

f=F + T, c ijE] + « „ (63) 

where the coefficients c are averaging coefficients defined by 

_ bid, a + GbidjjTjj 
Cil " Z (M* + GbOurn) (64) 

A 

and the coefficients b are the same as before. 

The first two terms on the right of (63) give an average of the in- 
dividual clock frequencies. The last term depends on the initial condi- 
tion, but it goes to zero as the system delays become large. Thus, the 
behavior indicated by (60) does not really occur in our model for organic 
systems. 

XIII. SOME REMARKS ON THE STABILITY PROBLEM 

The mathematical problem of stability is not yet satisfactorily solved 
for general organic systems. Two special families of organic systems are 
now known to be globally asymptotically stable. These are certain non- 
linear systems with zero delays and certain linear systems with delays 
and filters. These very special cases nourish the hope that broader 
sufficient conditions for stability can be found. 

The present section will be devoted to redefinition of the stability 
problem and a discussion of some necessary conditions for stability. 

We have seen that the system will malfunction whenever the M-di- 
mensional buffer state vector x(t) leaves the unit cube. This leads to the 
following practical definition of stability. 

Definition: For any positive c, trajectory x(t) is e-stable if 

max | Xi(t) | ^ e for ^ t < ». 

Definition: A trajectory is stable if there is an £ < 1 for which it is e- 
stable. 

The trajectory of an undisturbed organic system will depend upon the 
system parameters and the initial condition. Therefore, the domain of 
system stability must be defined in a space having the following coordi- 
nates, which appear in (51) through (54). G, h(-), a, b, u(-). A, D, 
x(0), E, -z and p(t) for t ^ 0. The initialization of the filter states must 
also be defined. 
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Several necessary conditions should be kept in mind when testing for 
stability. First, the asymptotic frequency of the system must lie within 
the controllable range, 

F + Et - G £ / ^ F + Ei + G, i « 1, 2, • • -, N. 

Second, the limit points of the buffer state trajectory must lie within 
the unit cube. Third, the system must be "connected," in some sense. 

The connectedness of the systems deserves further discussion. I have 
required that the organic systems must be connected in the following 
sense: that there must exist a directed transmission path from each 
center to eveiy other center. Belles' has used the same condition. On the 
other hand, the stability of the special nonlinear systems which I have 
treated depends upon a weaker condition. Namely, that the nonoriented 
graph having a branch corresponding to each link must be connected. 
This condition is used in Appendix B, which is essential to the proof. 

An important difference between the systems treated here and those 
of Bene§, is that the former have the additional control coefficients, 
bn ^ for (i.j) e R. Thus, the state xn(t) of a particular buffer may 
exert a control over the frequency of the sending center, j, as well as 
over the receiving center, i. 

Intuition suggests a necessary condition for stability based upon the 
control coefficients, an , 6<y , which appear in the family of equations, 
(51). Inasmuch as negative coefficients tend to make the systems un- 
stable, these are assumed to be either positive or zero. 

Consider a "control graph" with nodes numbered 1, 2, • • • , N. Let a 
directed branch exist from node j to node i if and only if a,- ; + &„• > 0. 
This condition permits the frequency at center i to be influenced by its 
phase relative to that at center j. Then a necessary condition for system 
stability is that the control graph shall have a node from which directed 
paths exist to all other nodes. 

Under this "weak" condition, some parts of the system may simply be 
"slaves" of another part of the system. The "strong" condition that 
there exist a directed path from each node to each other node precludes 
this possibility. However, it should be understood that the condition 
satisfied by the control graph need not be satisfied by the graph whose 
branches correspond to transmission links. This is the case because each 
link may give rise to two oppositely directed branches of the control 
graph. On the other hand, a connected system may lack stability when 
too few of the control coefficients are positive. 

A simple example is provided by the system shown in Fig. 4. The 
digital transmission links appear in the "system graph" Fig. 4 (a). When 
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Fig. 4 — A system graph and three control graphs, (a) system graph; (b) in- 
adequately connected control graph; (c) weakly connected control graph; (d) 
strongly connected control graph. 

the only positive coefficients are a-a , an , the control graph of Fig. 4(b) 
results. This fails to satisfy even the weak condition. It is clear that no 
means exists for bringing centers 1 and 3 to a common frequency. The 
control graph in Fig. 4 (c ) results when a J2 , 021 , &23 are the positive 
coefficients. It must be assumed that a separate means for transmitting 
the narrow band signal, 6 23 , to center 3 exists. This control graph satis- 
fies the weak condition. If the system is stable, center 3 will be a slave 
to the rest of the system. It will have no influence upon the frequency 
trajectories of centers 1 and 2. If a n , «2i , a 2 3 , 623 are the positive co- 
efficients, then the control graph of Fig. 4(d) results. This one obeys the 
strong condition. When the control graph is the same as the system 
graph, Fig. 4(a), it is weakly connected. In this case, if the system is 
stable, center 3 determines the common frequency. 

XIV. SUMMARY 

A class of systems for the mutual synchronization of spatially sepa- 
rated oscillators has been synthesized and a mathematical model for 
these systems has been presented. The model may be said to be physi- 
cally realizable in that real systems can be built whose function will 
very closely approximate the behavior of the model. While no such sys- 
tem hardware has been presented here, a simple hardware analog has 
been built. 9 

These systems, called "organic synchronization systems," have a 
possible application to continental or worldwide PCM communications. 

A re-examination of the systems treated by BeneS in the light of the 
newly derived organic model indicates that 

(i) his stability proof does apply to a particular class of linearized 
organic systems, and 



ORGANIC SYNCHRONIZATION 1729 

(m) that his formula for the final system frequency must be modified ; 
the suitably modified formula no longer displays a monotone de- 
creasing final frequency with increasing system delays. 

APPENDIX A 

Asymptotic Phase Differences 

The set of all differences of the form, (g,- — fa), can have at most 
(N — 1) linearly independent elements. To verify this, consider the 
(N — I) elements 

{q N - q N -i), (qit-i - fa'-t), • • •, (§2 - Qi). 

Suppose i > j. Then 

(fa - fa) = (fa - fa-i) + (fa-i ~ fa-*) + • • • + (fa+i - fa) 
while 

(fa -<?>)=- (fa ~ fa)- 

Hence, any other element of the set of differences can be represented as 
a linear combination of the selected (N — 1 ) elements. 

When the directed graph, which corresponds to the synchronizing net- 
work, is connected the set of differences 

{ (fa ~ fa) I (7,0 e R} 

has at least (N — 1) linearly independent elements. Actually, only the 
weak, i.e., nonoriented, sense of connectedness of necessaiy for the proof. 

Theorem: Let G be a directed graph with N vertices such that the correspond- 
ing nonoriented graph is connected. Associate the N independent real 
variables, q\\ , qt , • • • , q^ , one to one with the correspondingly indexed 
vertices. Associate the difference (§» — §,) with the edge from vertex i to 
vertex j, for each edge in G. Let T be any complete tree of G. 

Then, there is a set of (N — 1) linearly independent differences asso- 
ciated with edges of T. 

Proof: We shall proceed by induction. The theorem clearly is true when 
N = 2. 

Suppose the theorem to be true for N = L — \. Now consider G to 
have L vertices. Since it is connected, it contains a complete tree T, 
which will have L — 1 edges, but all L vertices. It follows that not all 
vertices can have more than one edge of T incident on them. Let vertex 
j be an end vertex. Then, only one of the differences associated with the 
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edges of t contains q } . It follows that this difference, say ±(§< — qf), 
is linearly independent of the remaining (L — 2) differences. But if 
vertex j and the edge incident on it are removed from T, a tree having 
(L — 1) vertices remains. By hypothesis, this contains (L — 2) edges 
whose associated differences are linearly independent. Hence, there are 
(L — 1) linearly independent differences associated with the edges of 
T, and the proof is complete. 

Corollary: The differences are unchanged when the average of the q's is 
subtracted from each of them. Therefore, the theorem applies even when 
the N real variables are constrained to have zero sum. 

APPENDIX B 

Properties of -L(w) 

Certain preliminaries concerning convex functions will be necessary 
here. While they are familiar to mathematicians, other readers may find 
the following review helpful. 

All sets to be considered here are subsets of finite dimensional real 
linear spaces. All functions will be defined on such sets. 

Definition 1 : A set of points X is convex if every point of the set 

{Xx 2 + (1 - X)xi:xi , x 2 e X and ^ X ^ If 

is also a point of X. 

Definition 2: A real valued function /(• ) defined on a convex set X is a 
convex function on X if 

/[Xx 2 + (1 - X) Xl ] =g X/(x 2 ) + (1 - X)/( Xl ) (65) 

whenever Xi , x 2 e X and ^ X ^ 1. 

A convex function /(•) is strictly convex if the equality in (65) im- 
plies that X = or X = 1 or Xi = x 2 . 

Theorem 1: If two convex functions are defined on the same convex set, 
their sum is a convex function on that set. If one of the functions is strictly 
convex, then the sum is strictly convex. 

Theorem 2: If /(• ) is a convex function on a convex set X, and if a ^ 0, 
then otf(-) is a convex function on X. ///(•) is strictly convex, and if 
a > 0, then af(-) is strictly convex. 

Theorem 3: If c is a fixed vector in an fi-dimensional space, and x is a 
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variable vector in the same space, and d is a real number, then (c -x + d) 
is a convex function on the entire space. 

Theorem 4-' Let /(•) be a convex function on an n-dimensional space. 
Then the sets of points 

|x:/(x) ^ d], |x:/(x) < d] 

are convex subsets of the space for every real number, d. 

The above theorems are elementary consequences of the definitions, 
1 and 2. 

Theorem 5: Let f{- ) be a differentiate convex function defined on a convex 
set X. Let Xi , x 2 be distinct points of X. Then the directional derivative, 
(d/dh) /[\X2 + (1 — X)xi], ?'s an increasing function of \ in (0,1). 

Proof: Select any X > 0, 5 > such that X -f 6 < 1. Let 

x = XoX 2 + (1 — X )xi , y = x 2 — xi . 
Then 

(X + <5)x 2 + (1 - X - 5)xi = x + 5y. 

Now select an e such that e > and Xo + 8 + e < 1 and apply (65) 
twice as follows: 

/(xo + 5y) - / [^ (xo + 5y + ey) + ^ x ] 
" -/(xo + 5y + f y) +_L_/( Xo ) 



~ 5 +£ ' J 8 +£ 

/(xo + ey) ^ r^— /(xo + 8y + ey) + -?— /(x„). 

Adding these inequalities and rearranging terms, 

/(xo 4- 5y + ey) - /(xo + ay) ^ /(*. + ey) - /(x«). 

Dividing both members by /■ and taking the limits as e — > yields the 
desired result, 



4/[Xx 2 + (1 -X) Xl ] 



^ -^r/[Xx 2 + (1 -X) Xl ] 

X„+6 "A 



Xo 



Corollary: If /(•) is strictly convex on the convex set X, and if X\ , x 2 
are distinct points of X, then (d/dX) f[\x 2 + (1 — X)xi] is a strictly 
increasing function of X in (0,1). 
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Proof: Suppose that the equality holds in Theorem 5. If the directional 
derivative is non decreasing in [X , (Xo + 8)] and takes equal values at 
the end points, then it must be constant on this interval. It follows that 
/(• ) varies linearly on the line segment from 

x = X„x 2 + (1 - Xo)x! to x = (Xo + 5)x 2 + (1 - Xo - 6)xi . 

This contradicts the hypothesis that/(-) is strictly convex on X, and 
the proof is complete. 

Theorem 6: Letf(- ) be a strictly convex differentiable function defined on a 
convex set D. Let C be a closed and bounded convex set in the interior of D. 
Then, 

(i) /(• ) assumes its minimum value over C at a unique point of C, 
(ii) /(• ) has a vanishing gradient at no more than one point of C, and 
(Hi) /(■ ) assumes its minimum value over C at an interior point of C 
if and only if the gradient of '/(• ) vanishes at that point. 

Proof: 

(i) The hypotheses imply that/(-) is a continuous function and 
that C is a compact set. It follows that/( • ) assumes its minimum 
value over C, / mi n , at some point of C. Now suppose that 
Xi , X2 are distinct points of C such that 

/( Xl ) = /(x 2 ) = / mi „ . 

Then the strict convexity of /(• ) implies that 

j(*+ f) </„,». 

This is a contradiction of the hypothesis that /„,;„ is the least 
value of /(• ) over C. 

(ii) Suppose the gradient of / vanishes at two distinct points of 
C, Xi and x 2 . Consider the directional derivative of /(•) along 
(x 2 — Xi). By hypothesis, this derivative vanishes at Xi . Be- 
cause /(• ) is strictly convex, it is a strictly increasing function 
of position along (x 2 — Xi). Therefore, it is greater than zero 
at x 2 , which contradicts the hypothesis that the gradient 
vanishes at x 2 . 

(Hi) Suppose /(xo) = /min and Xo is an interior point of C. All points 
in a neighborhood of x are in C. If the gradient of /(■ ) does not 
vanish at Xo , then there are points in this neighborhood, along 
the negative gradient from x , at which /(• ) assumes smaller 
values. This contradicts the hypothesis that / mi „ is the least 
value of /(■ ) in C. 
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Now suppose that the gradient of /( • ) vanishes at x , an in- 
terior point of C. Let Xi be any other point of C and consider 
the directional derivative of /(•) along (x x — x ). This vanishes 
at x by hypothesis. The strict convexity of /(•) implies that it 
is strictly increasing from x to Xi . Therefore, /(xi) > /(xo) and 
/(•) has its minimum over C at x . 
This completes the proof. 

In considering the properties of L(w), an additional result will be 
needed concerning the penalty function ?•(•)• Its properties are num- 
bered (i) through (v). Note that the convergence in (v) was not as- 
sumed to be uniform over the unit sphere. This property will now be 
deduced. 

Because r ( • ) is a strictly convex function on the M -dimensional 
vector space, it is also strictly convex on any subspace. In particular, 
r(sxi) is a strictly convex function of s for any Xi on the unit sphere. 
Then, for any real number P, however large, 

e(s,Xi) = r(sxi) — sP 

is a strictly convex function of s. Let E, be the set of vectors, x, on the 
unit sphere for which 

e(s,x) ^ 0. 

For any fixed s, E s is a closed subset of the unit sphere because e(s,x) 
is continuous. It follows that E a is a compact set. 

The corollary to Theorem 5 tells us that along any ray from the ori- 
gin, i.e., for s going from zero to infinity, the derivative of e(s,Xi) is 
strictly monotone increasing. From this it can be seen that Xi 4 E 8Q 
implies that Xi 4 E, for s > s . Therefore, the sets E, decrease as s 
increases from zero to infinity. 

The intersection of a class of compact, decreasing, nonempty sets is 
nonempty. Therefore, if 

so 

n E a = 0, 

8=0 

it is clear that there exists an so such that E s = for s ^ So . In this 
case, 

r(sx) > sP for all s ^ s (P) 

independent of x on the unit sphere. 
On the other hand, if 

n E s ^ 0, 

a=0 
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then there exists a unit vector Xi , such that 

r(sxi) ^ sP for all sin (0, °°). 

This contradicts hypothesis (v) concerning the penalty functions. 

Thus, we have seen that r(sx)/s goes to infinity with s uniformly for 
all x on the unit sphere. 

Now consider the function L(w), defined by (46), with w restricted 
to an (N — 1 ) -dimensional linear manifold orthogonal to l N . Let 

w = V -+- aU 

where a is a real number and v is restricted to the (N — 1 ) -dimensional 
linear subspace orthogonal to 1^ . 

In view of (38) and (42), L(w) can be put in the form, 

L(w) = L(v) = c T -v + d + r(KAv + b). (66) 

Here, c is a fixed N-dimensional vector, d is a scalar constant, and b 
is a fixed il'/-dimensional vector, with M ^ N. The fixed N X N matrix 
A is positive definite. It can be seen from the discussion in Appendix A 
and (38) that the fixed M X N matrix K is of rank (N - 1) for con- 
nected systems. Its null space is spanned by l N . 
Using the convexity of r (• ), 

r{\KAv) ^ M-b) + hr{KAv + b) 

r(KAv + b) ^ 2rQKAv) - r(-b). 

Using this in (6G), 

L(w) = L(v) ^ 2r$KA\) + c 7 '-v + d - r(-b). 

The right-hand member is dominated by its first term as | v | becomes 
large, uniformly over the subspace orthogonal to ljv . Therefore, we 
can find a sphere of sufficiently large radius so that 

L(v) > L(0) 

for all v on its surface. Then the minimum value of L(v) over this 
sphere is not assumed on the boundary. 

Now it will be shown that L(v) is a strictly convex function of v 
on the subspace orthogonal to 1* . Let 

xi = KAv! + b 

x 2 = KAvz + b. 

The properties of K and A are such that Vi j^ v 2 implies Xi ^ x 2 . This 
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permits us to apply the strict convexity condition, 

r[KA\v 2 + KA (1 - X)vi + b] 

= r[Xx 2 + (1 - X)xi] < Xr(x 2 ) + (1 - X)r(xi) 
= \r(KAv 2 + b) + (1 - \)r(KAv! + b). 

This is sufficient to establish the strict convexity of L(v). 

Inasmuch as the strictly convex function L(v) takes on its minimum 
value over every large sphere at an interior point, its gradient vanishes 
uniquely at that point. 

The above statement applies to the restriction of L (v) to an (N - 1 )- 
dimensional space. However, we know that w'(J) vanishes along U . 
Equation (47) then shows that 

V w L(w) = -1V(0 

vanishes along a direction which is not orthogonal to l N . It follows that 
the unrestricted gradient of L(w) vanishes at a unique point of every 
linear manifold orthogonal to \ N . 
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